Reconstructing Signing Avatars from Video Using Linguistic Priors

Sign language (SL) is the primary method of communication for the 70 million Deaf people around the world. Video dictionaries of isolated signs are a core SL learning tool. Replacing these with 3D avatars can aid learning and enable AR/VR applications, improving access to technology and online media. However, little work has attempted to estimate expressive 3D avatars from SL video; occlusion, noise, and motion blur make this task difficult. We address this by introducing novel linguistic priors that are universally applicable to SL and provide constraints on 3D hand pose that help resolve ambiguities within isolated signs. Our method, SGNify, captures fine-grained hand pose, facial expression, and body movement fully automatically from in-the-wild monocular SL videos. We evaluate SGNify quantitatively by using a commercial motion-capture system to compute 3D avatars synchronized with monocular video. SGNify outperforms state-of-the-art 3D body-pose- and shape-estimation methods on SL videos. A perceptual study shows that SGNify's 3D reconstructions are significantly more comprehensible and natural than those of previous methods and are on par with the source videos. Code and data are available at sgnify.is.tue.mpg.de

Spectral Subtraction of Robot Motion Noise for Improved Event Detection in Tactile Acceleration Signals

New robots for teleoperation and autonomous manipulation are increasingly being equipped with high-bandwidth accelerometers for measuring the transient vibrational cues that occur during con- tact with objects. Unfortunately, the robot\u27s own internal mechanisms often generate significant high-frequency accelerations, which we term ego-vibrations. This paper presents an approach to characterizing and removing these signals from acceleration measurements. We adapt the audio processing technique of spectral subtraction over short time windows to remove the noise that is estimated to occur at the robot\u27s present joint velocities. Implementation for the wrist roll and gripper joints on a Willow Garage PR2 robot demonstrates that spectral subtraction significantly increases signal-to-noise ratio, which should improve vibrotactile event detection in both teleoperation and autonomous robotics

Haptography: Capturing and Recreating the Rich Feel of Real Surfaces

Haptic interfaces, which allow a user to touch virtual and remote environments through a hand-held tool, have opened up exciting new possibilities for applications such as computer-aided design and robot-assisted surgery. Unfortunately, the haptic renderings produced by these systems seldom feel like authentic re-creations of the richly varied surfaces one encounters in the real world. We have thus envisioned the new approach of haptography, or haptic photography, in which an individual quickly records a physical interaction with a real surface and then recreates that experience for a user at a different time and/or place. This paper presents an overview of the goals and methods of haptography, emphasizing the importance of accurately capturing and recreating the high frequency accelerations that occur during tool-mediated interactions. In the capturing domain, we introduce a new texture modeling and synthesis method based on linear prediction applied to acceleration signals recorded from real tool interactions. For recreating, we show a new haptography handle prototype that enables the user of a Phantom Omni to feel fine surface features and textures

Global, regional, and national disability-adjusted life-years (DALYs) for 315 diseases and injuries and healthy life expectancy (HALE), 1990�2015: a systematic analysis for the Global Burden of Disease Study 2015

Background Healthy life expectancy (HALE) and disability-adjusted life-years (DALYs) provide summary measures of health across geographies and time that can inform assessments of epidemiological patterns and health system performance, help to prioritise investments in research and development, and monitor progress toward the Sustainable Development Goals (SDGs). We aimed to provide updated HALE and DALYs for geographies worldwide and evaluate how disease burden changes with development. Methods We used results from the Global Burden of Diseases, Injuries, and Risk Factors Study 2015 (GBD 2015) for all-cause mortality, cause-specific mortality, and non-fatal disease burden to derive HALE and DALYs by sex for 195 countries and territories from 1990 to 2015. We calculated DALYs by summing years of life lost (YLLs) and years of life lived with disability (YLDs) for each geography, age group, sex, and year. We estimated HALE using the Sullivan method, which draws from age-specific death rates and YLDs per capita. We then assessed how observed levels of DALYs and HALE differed from expected trends calculated with the Socio-demographic Index (SDI), a composite indicator constructed from measures of income per capita, average years of schooling, and total fertility rate. Findings Total global DALYs remained largely unchanged from 1990 to 2015, with decreases in communicable, neonatal, maternal, and nutritional (Group 1) disease DALYs offset by increased DALYs due to non-communicable diseases (NCDs). Much of this epidemiological transition was caused by changes in population growth and ageing, but it was accelerated by widespread improvements in SDI that also correlated strongly with the increasing importance of NCDs. Both total DALYs and age-standardised DALY rates due to most Group 1 causes significantly decreased by 2015, and although total burden climbed for the majority of NCDs, age-standardised DALY rates due to NCDs declined. Nonetheless, age-standardised DALY rates due to several high-burden NCDs (including osteoarthritis, drug use disorders, depression, diabetes, congenital birth defects, and skin, oral, and sense organ diseases) either increased or remained unchanged, leading to increases in their relative ranking in many geographies. From 2005 to 2015, HALE at birth increased by an average of 2·9 years (95 uncertainty interval 2·9�3·0) for men and 3·5 years (3·4�3·7) for women, while HALE at age 65 years improved by 0·85 years (0·78�0·92) and 1·2 years (1·1�1·3), respectively. Rising SDI was associated with consistently higher HALE and a somewhat smaller proportion of life spent with functional health loss; however, rising SDI was related to increases in total disability. Many countries and territories in central America and eastern sub-Saharan Africa had increasingly lower rates of disease burden than expected given their SDI. At the same time, a subset of geographies recorded a growing gap between observed and expected levels of DALYs, a trend driven mainly by rising burden due to war, interpersonal violence, and various NCDs. Interpretation Health is improving globally, but this means more populations are spending more time with functional health loss, an absolute expansion of morbidity. The proportion of life spent in ill health decreases somewhat with increasing SDI, a relative compression of morbidity, which supports continued efforts to elevate personal income, improve education, and limit fertility. Our analysis of DALYs and HALE and their relationship to SDI represents a robust framework on which to benchmark geography-specific health performance and SDG progress. Country-specific drivers of disease burden, particularly for causes with higher-than-expected DALYs, should inform financial and research investments, prevention efforts, health policies, and health system improvement initiatives for all countries along the development continuum. Funding Bill & Melinda Gates Foundation. © 2016 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY licens

Low Bitrate Source-filter Model Based Compression of Vibrotactile Texture Signals in Haptic Teleoperation

119scopu